Wiring cost in the organization of a biological network 
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To find out the role of the wiring cost in the organization of the neural network of the nematode 
Caenorhapditis elegans (C. elegans), we build the neuronal map of C. elegans based on geometrical 
positions of neurons and define the cost as inter-neuronal Euclidean distance d. We show that the 
wiring probability decays exponentially as a function of d. Using the edge exchanging method and 
the component placement optimization scheme, we show that positions of neurons are not randomly 
distributed but organized to reduce the total wiring cost. Furthermore, we numerically study the 
trade-off between the wiring cost and the performance of the Hopfield model on the neural network. 



Human beings have been attracted by their own brains' 
vast ability and complexity 0. Although the topology 
of connections between neurons in a brain is the basic 
interest in the brain research, it is impossible to obtain 
the whole connections of human brain directly because 
the number of neurons is so huge (more than hundreds 
of billions). Only macroscopic and indirect informations 
on connectivity are accesible in the entire brain's scale 
so far 0, 03> |H @- However, primitive organisms that 
have rather small sizes shed a light on the research of 
the structure of connections in a brain thanks to their 
relatively simple organization. 

A nematode Caenorhabditis elegans (C. elegans), 
which was the first multicellular organism whose whole 
genome was sequenced in 1998 6], is the one of such 
examples. The remarkable feature of this nematode is 
that most individuals of C. elegans have the same cel- 
lular properties such as shapes, connectivities and posi- 
tions of neurons, which makes it possible to label each 
neuron. Throughout the pioneering work by White et 
al, the connectivity of the neuronal network has been 
uncapped completely Q. 

A decade after the intensive works on the nematode, 
the researches on large-scale complex networks were ini- 
tiated. Since the founding works of modeling complex 
networks Q| Ql and the revealing of the real networks' 
structures [l(|, numerous models have been suggested 
and studied, and various real networks have also begun 
to reveal their characteristics, such as small- worldness, 
power-law degree distribution, and high level of cluster- 
ing [llj. The concepts, tools, and methods of the complex 
network researches have been diffused into various fields, 
especially into biology. 

As the knowledge about biological networks grows, the 
issue of identifying the organizing principle of them be- 
comes more substantial. In this issue, a powerful ap- 
proach is focusing on the high effectiveness of biosystems 
because of the very essentiality of natural selection in the 
evolution. There are evidences of optimization in biolog- 
ical networks as we see in the normal biological organs. 
For example, the average distance between two metabo- 
lites of 43 microorganisms' metabolic networks remain 



the same even though their numbers of nodes span from 
200 to 800 ^3 ■ This optimization viewpoint can be also 
applied to technological systems (e.g . electric circuit ^| , 
modular structure of a software [lj]) because technolog- 
ical systems also evolve by the pressure toward high ef- 
ficiency. It was discovered that the power-law degree 
distribution can come out from the optimization based 
models 0, 0, . In these models, a total cost is de- 
fined as the number of links (or total length of links) and 
the effectiveness is defined by several different measures, 
such as the short average distance or the large clustering 
coefficient. The energy function to be optimized is de- 
fined using the cost and the effectiveness measures, and 
then, by minimizing the energy function, the scale-free 
network emerges as a result. 

Evolution has built the current state of the brain. The 
main function of the brain is the capability to recognize 
and react flexibly to the various patterns of surround- 
ing situations because it greatly helps survival and re- 
production of an organism. In this context, the pattern 
recognition ability of Hopfield model was adopted 
as a measure for the functionality of a neuronal net- 
work 18]. However, when the performance of a neu- 
ronal network is only defined by the pattern recognition 
ability, the neuronal network of C. elegans shows worse 
performance than Barabasi- Albert (BA) network |9j and 
Watts-Strogatz (WS) network @ with the rewiring prob- 
ability p = 1.0 18]. Because they are random network 
models which are not designed for the neural compu- 
tation, this result may imply two different conclusions: 
The measure is invalid, or the measure reflects the true 
performance of the neural network but there are other 
constraints which obstruct the pressure to make a high 
performance neural network. 

A probable constraint is the cost. We need to build a 
very complex (expensive) structure for a well-functioning 
brain and it consumes a large amount of energy. There- 
fore, the efficiency of it highly limits its function [l9j . 
Furthermore, the strong evidence of the cost optimiza- 
tion in C. elegans was discovered by showing that the 
natural position of ganglia in C. elegans has the lowest 
wiring cost among the vast number of all possible posi- 
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FIG. 1: (a) The schematic diagram of the locations of the 
neurons in C. elegans (b) The locations of head neurons, 
neuropile, and ventral cord and the connections between the 
head neurons, (c) The schemetaic diagram of constructing 
the three-dimensional neuronal map from a two-dimensional 
figure of the head neurons. 



tioning combinations [2(|. Here, we construct the three- 
dimensional neuronal map of C. elegans, and we display 
and estimate the effect of the cost against the effect of the 
performance in the organization of the neural network of 
C. elegans. 

First of all, we construct the map of neurons in C. 
elegans. We define the positions of neurons as that of 
the soma which is collected from the figures of the ac- 
tual nervous system • We introduce following assump- 
tions to construct three-dimensional map from the two- 
dimensional figures. The first assumption is that the 
head neurons wrap the pharynx closely and they are 
located on the surface of an imaginary cyllinder whose 
diameter is the same as the pharynx's diameter. At the 
center of the body, we put the neurons that appear in the 
both figures from the viewpoint of left-side and right-side. 
We place the ventral cord neurons at the bottom center 
of the body. For the tail neurons, we assume that they 
are on the line y — z and y — —z. We assume that the 
remaining body neurons are placed just below the cuti- 
cle layer due to the pseudocoelome (body cavity) of the 
organism. The positions of neurons and the schematic 
diagram of map construction is shown in Fig. ^ 

Although the wiring is generally not straight and 
guided by the structures such as the nerve ring and the 
ventral cord, we start here with the null hypothesis that 
approximates the wiring cost between any two neurons 
is only proportional to the Euclidean distance between 
them and the total cost is defined by the sum of the 
costs of all connected neuron pairs (the head-tail length 
of the worm is normalized to I for convenience). 

The cost distribution of the original C. elegans network 
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FIG. 2: The cumulative plot of inter-neuron distance (d) 
distribution in C. elegans (The non-cumulative distribution 
is calculated by differentiating the cumulative distribution). 
The distribution shows piecewise exponential decay. We plot 
the case that all neurons are randomly distributed through 
the body ("Random position"). This distribution has the 
functional form of (d — l) 2 . If we ignore the extremely long- 
range links (d > 0.75), the original network has less long links 
and much larger amount of short links in comparison with 
this random distribution. The inset shows the distance dis- 
tribution of the neuron pairs only in the head. The kink is 
made by the gap between left part of the head neurons and 
the right part of them, which corresponds to the radius of 
pharynx, 0.02. If we make a projection of all the neurons 
onto the plane that is orthogonal to x axis, the kink vanishes. 



is shown in Fig. [21 Through the whole body, the cost dis- 
tribution exhibits piecewise exponential decaying distri- 
bution with three different length scales: 0.03, 0.01, and 
0.74. i.e., each piece decays as e~ d ^ where £ is 0.03, 0.01 
and 0.74 for each. The longest length scale 0.74 is same as 
the length scale where body-spanning long link appears. 
We believe that the other two length scales in the head 
are related to the radius of pharynx (— 0.02). We draw 
the distribution made by randomly distributing the po- 
sitions of all the neurons anywhere in the body and com- 
pare it with the original neural network's distribution. 
Note that, in the original neural network, there are cer- 
tain amount (about 10%) of long range links which span 
about 80% of the whole body and these body-spanning 
wirings must be crucial for the coordinated function of 
the worm, such as coherent movement and the egg-laying 
behavior, as is the spinal cord in our body. Besides these 
long range links, the neural network has smaller number 
of middle range links and much larger number of short 
links, which supports our proposition that the wiring cost 
is an important factor in C. elegans. This result also im- 
plies the existence of the relation between the connection 
probability and the Euclidean distance of neuron pairs 
although the connections are not straight in reality, as 
suggested in plj . 

To seek further evidences for the role of the wiring 
cost, we introduce two variational methods. The con- 
nections (neural circuit's topology) and the positions are 
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FIG. 3: C. elegans neuronal network's cost is compared with 
randomly shuffled networks and an optimized network. 'Node 
swapping' stands for the cost of the network which the nodes 
are randomly swapped, 'edge exchange' stands for that of 
which the edges are randomly exchanged, and the 'optimized' 
stands for the network whose cost is optimized by node- 
swapping method. The dark box shows the cost of the net- 
work whose long range links (> 0.75) are removed. The stan- 
dard deviation is shown. 



two of the most important entities in a neural network 
and hence two methods vary either of them. The first 
method is the edge exchange method suggested in p^ . 
which conserves the positions and degrees of nodes, but 
changes individual links randomly. The second method 
is the node swapping method that is used in ppj and 
named as Component Placement Optimization (CPO), 
which randomly chooses two nodes and swap the posi- 
tions while preserving all the connections (Note that the 
word 'optimization' may mislead. We use this method 
not only for optimizing a network but also randomizing 
a network and we call it "node swapping method" hence- 
forth). We randomly shuffle the original network using 
both methods and compare the resulting networks with 
the original one. In addition, we also compare them with 
the network that is optimized with Monte Carlo method. 
We start with high temperature and slowly drop the tem- 
perature. We draw the result in the Fig [3] The original 
network's total cost is smaller than that of the randomly 
shuffled networks, which supports that there exists the 
role of the cost in the organization of the C. elegans neu- 
ral network. Moreover, if we remove body-spanning links 
(> 0.75 ), the cost ratio of the original network to the 
optimized one is enhanced from 0.53 to 0.67. ft means 
there are lots of long range links which have to be placed 
without consideration of the cost. 

To observe the relation between the performance and 
the cost more systematically, we make a randomly shuf- 
fled network which have a desired total wiring cost. The 
result is shown in Fig. ^ This figure shows the nega- 
tive correlation between the total cost and the clustering 
coefficient. We observe that the network whose cost is 
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FIG. 4: The total cost versus the clustering coefficient. We 
make networks which have a designated total cost and calcu- 
late the clustering coefficient of them. 



minimized by the edge exchange method has the clus- 
tering coefficient of 0.43, which is much larger than the 
original network (0.28). And we also observe that the 
network, whose cost is maximized by the same method, 
shows pretty low clustering coefficient (0.02) than the 
original. Note that the C. elegans's neuronal network 
without body-spanning long links has similar clustering 
coefficient with the cost-tuned random network, ft means 
that the clustering coeffient is not an important factor 
in the organization of C. elegans neuronal network and 
those body spanning links don't contribute to the clus- 
tering coefficient. 

We show that although the C. elegans neural network 
is not a cost-optimal network, the network is far from 
random. The connection probability follows exponential 
decaying law of Euclidean distance, and if we neglect 
body-spanning long links, which may be considered as a 
spinal cord in human, the total cost approaches to the 
position-optimal network and the clustering coefficient 
approaches to that of the cost-tuned random network. 
We cannot find the evidence that the clustering coeffi- 
cient affects the structure of the neuronal network. But, 
we find that the body-spanning links (20% of all links) 
do not increase the clustering coefficient much. Because 
the high level of clustering increases the path length in 
general (WS network and power grid), this fact may im- 
pliy that those body-spanning links are designed to con- 
nect all neurons throughout the body effectively. And 
although the effect of clustering coeffient in the organi- 
zation of the neuronal network cannot be found, we show 
that the total wiring cost competes with the clustering 
coefficient that is closely related to the pattern retrieval 
performance of Hopfield model. 

We want to suggest three reasons why the C. elegans 
neural network is not cost-optimal. First possible rea- 
son is the existence of the neuropile, such as the nerve 
ring and ventral cord, which is expected to reduce the 
wiring cost between distant neurons. Second one is the 
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functional constraints. The minimal subnetwork topolo- 
gies for generating certain dynamical behaviors such as 
oscillation or chaotic motion are identified and named as 
"dynamical motifs" 23] . This result shows that some 
network topologies are unavoidable to perform certain 
behaviors and these essential topologies may obstruct the 
wiring cost optimization. The last reason is the devel- 
opmental constraints. The developmental plan of every 
living organism is highly conserved through the history 
of life [24J , which means the plan can be changed hardly 
and hence is a highly optimized process. Because more 
complex development process needs more cost and has 
higher risk of failure, an organism should makes the de- 
velopment process as simple as possible. That is, even 
if C. elegans can minimize the wiring cost by modify- 
ing the developmental process, the minimization may not 
happen because of the developmental cost. Although the 
cost is also an important issue in the human brain, our 
developmental program does not control the development 



of every single neuron |25| . 

We conclude that although the wirings generally fol- 
low non-optimal paths, the wiring probability is largely 
determined by the Euclidean distance between the neu- 
rons and the wiring cost is an important factor that af- 
fects the development of neural network of C. elegans and 
competes with the clustering coeffient. 
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